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Amendments to the Claims : 

This listing of claims will replace all prior versions, and listings, of claims in the application. 
Listing of Claims : 

1 (Currently amended). A method of associating additional information with a video 
including a plurality of frames comprising: 

(a) identifying at least one of said frames representative of a picture 
composed of a plurality of pixels; 

(b) providing a descriptive stream separate from said video; 

(c) including said additional information in said descriptive stream related to 
said at least one of said frames; 

(d) providing said video for displaying on a display; 

(e) selectively providing said additional information to a viewer 
approximately the time of said providing said video where said additional 
information is an object depicted by said picture by said pixels; 

(f) wh e r e in said d e scriptiv e str e am includ e s copyright information indicating 
th e own e r of the copyright of said vid e o . wherein said additional 
information includes executable computer program code. 

2 (Original). The method of claim 1 wherein said additional information includes at 
least one of an object index, a textual description, a voice annotation, an image feature, an object 
link, a URL link, and a Java applet. 

3 (Original). The method of claim 1 wherein said identifying is an object within said 

frame. 

4 (Original). The method of claim 1 where said descriptive stream is related to a 
plurality of said frames. 
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5 (Original). The method of claim 4 wherein said at least one of said frames are in 
sequential order in said video. 

6 (Original). The method of claim 4 wherein said at least one of said frames are in 
nonsequential order in said video. 

7 (Original). A method of claim 3 wherein said additional information is related to said 

object. 

8 (Original). The method of claim 1 wherein said descriptive stream includes an index 
synchronizing said video with said descriptive stream. 

9 (Canceled). 

10 (Original). The method of claim 1 wherein said descriptive stream is encoded 
separately from said video. 

1 1 (Original). The method of claim 10 wherein said video is decoded in the same manner 
independently of whether said descriptive stream is provided. 

12 (Original). The method of claim 1 1 wherein said video is at least one of MPEG-2 and 
television broadcast format. 

13 (Original). The method of claim 1 wherein said additional information is presented to 
said viewer on a remote control. 

14 (Original). The method of claim 1 wherein an audible signal indicates the availability 
of said additional information. 
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15 (Original). The method of claim 1 wherein a visual signal indicates the availability of 
said additional information. 

16 (Original). The method of claim 7 wherein said additional information includes 
textual based information related to said object. 

17 (Original). The method of claim 7 wherein said additional information includes 
audible information related to said object. 

18 (Original). The method of claim 7 wherein said additional information includes image 
features comprising at least one of texture, shape, dominant color, and a motion model related to 
said object. 

19 (Original). The method of claim 7 wherein said additional information includes links 
to at least one of other objects and frames within said video. 

20 (Original). The method of claim 7 wherein said additional information includes 
program instructions related to said object. 

21 (Currently amended). A video system comprising: 

(a) an encoder that includes additional information within a video stream 
including a video including a plurality of frames representative of a 
picture composed of a plurality of pixels, where said additional 
information is related to at least one of said frames; 

(b) a receiver that receives said video and said additional information, and 
said receiver decodes said video in the same manner independently of 
whether said additional information is provided; 

(c) a display for displaying said video; 

(d) a trigger mechanism for selectively presenting said additional information 
to a viewer at approximately the time of presenting said frames to said 
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viewer where said additional information is an object depicted by said 
picture by said pixels; 
(e) wh e r e in said d e scriptiv e str e am includ e s copyright information indicating 
th e own e r of th e copyright of said video, wherein said additional 
information includes executable computer program code. 

22 (Original). The system of claim 21, further comprising: 

(a) a transmitter for transmitting said video signal and said additional 
information; and 

(b) a receiver for receiving said video signal and said additional information. 

23 (Original). The system of claim 22 wherein said encoder is at least one of a video 
camera and a computer. 

24 (Original). The system of claim 21 wherein said trigger mechanism is located in a 
remote control device. 

25 (Original). The system of claim 21 wherein said additional information is provided by 
a remote control device. 

26 (Original). The method of claim 21 wherein said additional information is related to 
an object within said frame and includes links to at least one of other objects and frames within 
said video. 

27 (Original). The method of claim 21 wherein said additional information is related to 
an object within said frame and includes program instructions related to said object. 

28 (Original). The method of claim 21 wherein said additional information is related to 
an object within said frame and includes textual based information related to said object. 
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29 (Original). The method of claim 21 wherein said additional information is related to 
an object within said frame and includes audible information related to said object. 

30 (Original). The method of claim 21 wherein said additional information is related to 
an object within said frame and includes image features comprising at least one of texture, shape, 
dominant color, and a motion model related to said object. 

31 (Currently amended). A system for presenting information comprising: 

(a) a single unitary file stored on a recordable media containing both only a 
single image representative of a picture composed of a plurality of pixels 
and additional information associated with said image, wherein said image 
is stored in a first part of said file and said additional information is stored 
in a second part of said file , said single unitary file does not contain any 
other images than said single image, wherein said single unity file is not 
part of a video sequence ; 

(b) a selection mechanism that reads said single image from said single unity 
file and permits the selection of graphical objects depicted by said picture 
by said pixels in said image for which said additional information is 
related thereto; and 

(c) a presentation mechanism that provides said additional information to a 
viewer in response to selecting said object depicted by said picture by said 
pixels. 

32 (Original). The system of claim 31 wherein said file includes said image followed by 
said additional information. 

33 (Original). The system of claim 32 wherein said image and said additional 
information are separated by a marker indicating the end of said image. 
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34 (Original). The system of claim 33 wherein an image viewer which does not 
recognize said additional information will display said image properly and recognize said marker 
as indicating the end of said image. 

35 (Original). The system of claim 34 wherein said image is in a JPEG format. 

36 (Original). The system of claim 31 wherein said additional information is organized 
in at least two layers comprising: 

(a) a first layer containing information describing the location of objects 
within said image; and 

(b) a second layer containing additional information regarding said objects 
within said image, where said first layer contains fewer bytes than said 
second layer. 

37 (Original). The system of claim 36 wherein said second layer follows said first layer, 
which in turn follows said image file. 

38 (Original). The system of claim 36 wherein said first layer contains a length identifier 
describing the length of said first layer. 

39 (Original). The system of claim 36 wherein said first layer contains a number of 
objects identifier describing the number of objects identified by said first layer. 

40 (Original). The system of claim 36 wherein said first layer contains a number of data 
identifier describing the number of data items associated with a particular said object. 

41 (Original). The system of claim 36 wherein said first layer contains a first definition 
of the outline of an object of said image. 
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42 (Original). The system of claim 36 wherein said second layer contains a length 
identifier describing the length of said second layer. 

43 (Original). The system of claim 36 wherein said second layer contains an array of 
offsets that identify the start of each data item. 

44 (Original). The system of claim 41 wherein said second layer contains a second 
definition of the outline of said object of said image, where said second definition more closely 
approximates the outline of said object than said first definition. 

45 (Original). The system of claim 41 wherein said second layer contains a second 
definition of the outline of said object of said image, where said second definition contains more 
bytes than said first definition. 

46 (Original). The system of claim 36 wherein said second layer includes sound data 
related to said object. 

47 (Original). The system of claim 36 wherein said second layer includes HTML meta 
tags related to said object. 

48 (Original). The system of claim 36 wherein said second layer includes textual 
annotations related to said object. 

49 (Original). The system of claim 36 wherein said second layer includes an HTML page 
to be rendered. 

50 (Original). The system of claim 36 wherein said second layer includes a Java Applet 
related to said object. 
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51 (Original). The system of claim 36 wherein said second layer includes a color 
histogram. 

52 (Original). The system of claim 36 wherein said second layer includes data related to 
the conditions under which said image was created including at least one of lighting, camera 
settings, and time of acquisition. 

53 (Original). The system of claim 36 wherein said second layer includes data related to 
information for reproducing said image including at least one of cropping information, paper 
type, camera settings, and image production settings. 

54 (Original). The system of claim 36 wherein said second layer includes another image 
to be superimposed upon said image. 

55 (Original). The system of claim 36 wherein said second layer includes data regarding 
the author of said image. 

56 (Original). The system of claim 36 wherein said second layer includes copyright data 
regarding the copyright of said image. 

57 (Original). The system of claim 56 said copyright data is encoded. 

58 (Original). The system of claim 36 wherein said second layer includes information 
regarding how said image should be viewed. 
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59 (Currently amended). A method of presenting information comprising: 

(a) displaying an image from a single unitary file stored on a recordable 
media_containing both only a single image representative of a picture 
composed of a plurality of pixels and additional information associated 
with said image, where said image is stored in a first part of said file and 
said additional information is stored in a second part of said file , said 
single unitary file does not contain any other images than said single 
image, wherein said single unity file is not part of a video sequence ; 

(b) selecting an object depicted by said picture by said pixels in said image for 
which said additional information is related thereto; and 

(c) providing said additional information to a viewer in response to selecting 
said object depicted by said picture by said pixels. 

60 (Original). The method of claim 59 wherein said file includes said image followed by 
said additional information. 

61 (Original). The method of claim 60 wherein said image and said additional 
information are separated by a marker indicating the end of said image. 

62 (Original). The method of claim 61 wherein an image viewer which does not 
recognize said additional information will display said image properly and recognize said marker 
as indicating the end of said image. 

63 (Original). The method of claim 62 wherein said image is in a JPEG format. 

64 (Original). The method of claim 59 wherein said additional information is organized 
in at least two layers comprising a first layer containing information describing the location of 
objects within said image and a second layer containing additional information regarding said 
objects within said image, where said first layer contains fewer bytes than said second layer. 
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65 (Original). The method of claim 64 wherein said second layer follows said first layer, 
which in turn follows said image file. 

66 (Original). The method of claim 64 wherein said first layer contains a length identifier 
describing the length of said first layer. 

67 (Original). The method of claim 64 wherein said first layer contains a number of 
objects identifier describing the number of objects identified by said first layer. 

68 (Original). The method of claim 64 wherein said first layer contains a number of data 
identifier describing the number of data items associated with a particular said object. 

69 (Original). The method of claim 64 wherein said first layer contains a first definition 
of the outline of an object of said image. 

70 (Original). The method of claim 64 wherein said second layer contains a length 
identifier describing the length of said second layer. 

71 (Original). The method of claim 64 wherein said second layer contains an array of 
offsets that identify the start of each data item. 

72 (Original). The method of claim 69 wherein said second layer contains a second 
definition of the outline of said object of said image, where said second definition more closely 
approximates the outline of said object than said first definition. 

73 (Original). The method of claim 69 wherein said second layer contains a second 
definition of the outline of said object of said image, where said second definition contains more 
bytes than said first definition. 
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74 (Original). The method of claim 64 wherein said second layer includes sound data 
related to said object. 

75 (Original). The method of claim 64 wherein said second layer includes HTML meta 
tags related to said object. 

76 (Original). The method of claim 64 wherein said second layer includes textual 
annotations related to said object. 

77 (Original). The method of claim 64 wherein said second layer includes an HTML 
page to be rendered. 

78 (Original). The method of claim 64 wherein said second layer includes a Java Applet 
related to said object. 

79 (Original). The method of claim 64 wherein said second layer includes a color 
histogram. 

80 (Original). The method of claim 64 wherein said second layer includes data related to 
the conditions under which said image was created including at least one of lighting, camera 
settings, and time of acquisition. 

81 (Original). The method of claim 64 wherein said second layer includes data related to 
information for reproducing said image including at least one of cropping information, paper 
type, camera settings, and image production settings. 

82 (Original). The method of claim 64 wherein said second layer includes another image 
to be superimposed upon said image. 
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83 (Original). The method of claim 64 wherein said second layer includes data regarding 
the author of said image. 

84 (Original). The method of claim 64 wherein said second layer includes copyright data 
regarding the copyright of said image. 



85 (Original). The method of claim 64 said copyright data is encoded. 



86 (Original). The method of claim 64 wherein said second layer includes information 
regarding how said image should be viewed. 



87 (Currently amended). A method for creating an image file comprising: 

(a) providing a single image representative of a picture composed of a 
plurality of pixels; 

(b) selecting an object depicted by said picture by said pixels in said image; 

(c) providing additional information related to said object; and 

(d) storing both said single image and said additional information in a single 
unitary file stored on a recordable media, where said file includes only a 
single image and said image is stored in a first part of said file and said 
additional information is stored in a second part of said file , said single 
unitary file does not contain any other images than said single image, 
wherein said single unity file is not part of a video sequence . 



88 (Original). The method of claim 87 wherein said file includes said image followed by 
said additional information. 



89 (Original). The method of claim 88 wherein said image and said additional 
information are separated by a marker indicating the end of said image. 
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90 (Original). The method of claim 89 wherein an image viewer which does not 
recognize said additional information will display said image properly and recognize said marker 
as indicating the end of said image. 

91 (Original). The method of claim 90 wherein said image is in a JPEG format. 

92 (Original). The method of claim 87 wherein said additional information is organized 
in at least two layers comprising a first layer containing information describing the location of 
objects within said image and a second layer containing additional information regarding said 
objects within said image, where said first layer contains fewer bytes than said second layer. 

93 (Original). The method of claim 92 wherein said second layer follows said first layer, 
which in turn follows said image file. 

94 (Original). The method of claim 92 wherein said first layer contains a length identifier 
describing the length of said first layer. 

95 (Original). The method of claim 92 wherein said first layer contains a number of 
objects identifier describing the number of objects identified by said first layer. 

96 (Original). The method of claim 92 wherein said first layer contains a number of data 
identifier describing the number of data items associated with a particular said object. 

97 (Original). The method of claim 92 wherein said first layer contains a first definition 
of the outline of an object of said image. 

98 (Original). The method of claim 92 wherein said second layer contains a length 
identifier describing the length of said second layer. 
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99 (Original). The method of claim 92 wherein said second layer contains an array of 
offsets that identify the start of each data item. 

100 (Original). The method of claim 97 wherein said second layer contains a second 
definition of the outline of said object of said image, where said second definition more closely 
approximates the outline of said object than said first definition. 

101 (Original). The method of claim 97 wherein said second layer contains a second 
definition of the outline of said object of said image, where said second definition contains more 
bytes than said first definition. 

102 (Original).The method of claim 92 wherein said second layer includes sound data 
related to said object. 

103 (Original). The method of claim 92 wherein said second layer includes HTML meta 
tags related to said object. 

104 (Original). The method of claim 92 wherein said second layer includes textual 
annotations related to said object. 

105 (Original). The method of claim 92 wherein said second layer includes an HTML 
page to be rendered. 

106 (Original).The method of claim 92 wherein said second layer includes a Java Applet 
related to said object. 

107 (Original).The method of claim 92 wherein said second layer includes a color 
histogram. 
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108 (Original). The method of claim 92 wherein said second layer includes data related to 
the conditions under which said image was created including at least one of lighting, camera 
settings, and time of acquisition. 

109 (Original). The method of claim 92 wherein said second layer includes data related to 
information for reproducing said image including at least one of cropping information, paper 
type, camera settings, and image production settings. 

110 (Original). The method of claim 92 wherein said second layer includes another image 
to be superimposed upon said image. 

111 (Original). The method of claim 92 wherein said second layer includes data regarding 
the author of said image. 

112 (Original). The method of claim 92 wherein said second layer includes copyright data 
regarding the copyright of said image. 

113 (Original). The method of claim 92 said copyright data is encoded. 

1 14 (Original).The method of claim 92 wherein said second layer includes information 
regarding how said image should be viewed. 

115 (Original). The method of claim 92 wherein said first layer is transmitted from a first 
computer to a second computer together with said image. 

116 (Original). The method of claim 115 wherein portions of said second layer are 
transmitted from said first computer to said second computer upon request by said first 
computer. 
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117 (Original). The method of claim 1 16 wherein said request is in response to a user 
selecting an object within said image. 
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